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Research has shown that emotions play a significant role in the learning process and aca¬ 
demic achievement. However, the fact that measurement of emotions during or after 
instruction usually requires written responses on lengthy research instruments has been 
given as a reason why researchers have tended to avoid research on this topic in classrooms. 
Consequently, we developed a short Likert-scale instrument which used only three items 
within the three factors of interest, well-being and boredom to measure adolescent emotions 
during instruction in science education. We present four different studies in four populati¬ 
ons to assess the validity of the scale. In order to determine the reliability and validity of the 
instrument, it was administered to pupils across a range of grades (grades 6-12) after being 
taught standardised lessons by 14 teachers in south-western Germany. The data generated 
were analysed statistically in terms of their reliability and validity. As the three independent 
factors (interest, well-being and boredom) had been derived from theoretical constructs, 
confirmatory factor analysis was applied. In a second study based on pupils from different 
age groups, grades and school subjects, we found different scores according to age and sub¬ 
ject, suggesting that the scale is sensitive to these parameters. A third study used two 
standardised educational programs in zoology and botany for 5 th and 6 th graders to assess 
the scale’s sensitivity towards changes in emotions. Pupils rated the zoological topic as mo¬ 
re interesting than the botanical topic, as less boring and they felt better. External validity 
was determined by correlating the data that was generated using our scale in a fourth study 
on University students with the data generated by an established measurement of motivati¬ 
on (the shortened German version of the KIM - “Kurzskala zur Intrinsischen Motivation”). 

The data generated suggest that the three factors cluster satisfactorily and that the instru¬ 
ment, which can be administered with minimum disruption of classroom time, is both 
reliable and valid. 

Keywords: science education, boredom, emotions, interest, well-being, short assessment instru¬ 
ment 


Introduction 

According to Pintrich, Marx and Boyle (1993), learning processes involve more than “cold cog¬ 
nition” and include additional factors such as affective and social variables which need to be 
taken into account when investigating learning processes. More recent psychological studies em- 
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phasise the significance of emotions in learning and achievement (Mayring & Rhoneck, 2003; 
Pekrun, 2000). Students experience learning and achievement situations individually in a differ¬ 
ent manner depending on their previous experiences, their social context, their own personal 
goals, their individual interests, and a number of other personality factors (Gotz, Zirngibl, Pek¬ 
run, & Hall, 2003). For example, Allen (2010) found that pupils who experienced more intense 
emotions during an educational intervention demonstrated the most gains after the process. 

However, until recently there has been a general paucity of data on the role of emotions in 
classroom instruction (Glaser-Zikuda, FuB, Laukenmann, Metz & Randier, 2005; Pekrun, Gotz, 
Titz, & Perry, 2002) and where research has been done it has tended to focus on the cognitive- 
emotional construct „interest". One reason why emotions have not been studied in instructional 
situations was due to the fact that they were seen as interfering with learning and achievement 
(Glaser-Zikuda et al., 2005). At best, they are mentioned as motivational aptitude or as affective 
learning outcome (Fraser, Walberg, Welch, & Hattie, 1987). However, Varlander (2008) argues 
that emotions should not be considered as hindering learning, but rather as being a natural part of 
it and as having a focal role in the process, and the positive impact of interest on learning proc¬ 
esses has been confirmed with regard to both knowledge domains and subject areas (Hidi, Bern- 
dorff, & Ainley, 2002). Teachers" didactic competencies, students" academic achievement and 
interest, and social interactions have been found to correlate with successful learning processes at 
school (Hascher, 2003), and boredom has been shown to be related to attention problems and 
negative intrinsic motivation (Pekrun, Gotz, Daniels, Stupnisky, & Perry, 2010). 

Much of the previous work on emotions (and especially on interest) is based on trait-survey 
studies (assuming that a given trait is a personality variable that is resistant to short and sudden 
changes) by using questionnaires in cross-sectional designs assessing, e.g. interest, across grades 
and school topics, often in retrospect. In our study, we used a concept that distinguishes between 
current situational emotions and biographically developed and enduring “trait”- emotions (Ulich 
& Mayring, 1992) as interest may fluctuate during a lesson (Palmer, 2009). The idea behind this 
distinction can be clarified by the following example: Pupils may experience a particular lesson, 
e.g. a hands-on lesson or a specific topic, as interesting even though they do not have a general 
interest in the subject itself (see Laukenmann et al., 2003). Here, we define “situational emo¬ 
tions” as emotions that are sensitive to changes and that are not developed as a stable trait factor 
(as, e.g. general interest in a specific topic). Like many psychological variables, state and trait 
components exist simultaneously (Spielberger, Gorsuch, & Lushene, 1970). 

A central aspect of implementation and of treatments in learning studies is the need to as¬ 
sess situational emotions as some kind of moderating variables, because they are related to learn¬ 
ing success. There were just very few approaches that measured situational emotions (see as ex¬ 
amples, Glaser-Zikuda, 2010; Glaser-Zikuda et al., 2005). The main focus of our present work is 
to further modify a short scale to measure differences in emotions during learning processes; this 
specific scale is supposed to be applied in different educational settings, such as in out-of-school 
as well as in typical school settings, and from 5 th grade up to university level, as well as in formal 
and informal learning environments. The short scale has its benefit because it is less time con¬ 
suming and can be applied many times during an educational unit at the end of lessons. 

As there is a need to assess situational emotions as a moderating variable when imple¬ 
menting educational interventions and, because there are very few approaches that measure situ¬ 
ational emotions (Glaser-Zikuda, 2010; Glaser-Zikuda et al., 2005), the main focus of our study 
was to investigate the reliability and validity of a short scale to measure situational emotions in 
different educational settings from 5 th grade up to university level (the benefit of the short scale 
being that it is less time consuming and can be applied many times during an educational unit at 
the end of individual lessons). For the purposes of the study we differentiated between a more 



Situational Emotions in Science Education 361 


cognitive-evaluative (satisfaction) and a more affective (joy) dimension in terms of the concept 
‘well-being’ (c.f., Strack, Argyle, & Schwarz, 1990; Mayring, 2009). Interest is defined as a 
specific subject-topic-relationship which specifically includes importance and utility (c.f., Hidi, 
Renninger & Krapp, 1992), and boredom is defined by the components lack of action and inter¬ 
est, as well as subject-related boredom (c.f. Bellebaum, 1990; Csikszentmihalyi & LeFevre, 
1987). Well-being is more related to a subjective positive feeling during the lessons, while inter¬ 
est has a more cognitive orientation, and boredom finally is related to a lack of action and inter¬ 
est. 

Previous work assessed situational emotions immediately after school lessons by using dif¬ 
ferent versions of a situational emotion scale (Glaser-Zikuda et al., 2005; Glaser-Zikuda & Full, 
2008; Laukenmann et al., 2003; Randier, 2004, 2009). In this study we investigate the reliability 
and validity of a much shorter scale based on just three items for each of the dimensions; interest, 
well-being and boredom. The resultant nine-item scale is easy to apply in most school situation, 
for example at the end of a lesson or a field trip. We present four different studies based on four 
different pupil/student populations. The first study was done to provide evidence for the factor 
structure of the three dimensions (interest, well-being, boredom) of the scale, the second study 
sought evidence for sensitivity across different subjects and across different grades (we assumed 
that pupils would assess different lessons and subjects differently - as is known from trait sur¬ 
veys). The third study was done to assess sensitivity on an individual basis (individual reactions 
to different lessons in biology, namely zoology versus botany, were presented). Finally, we used 
another scale based on a different motivational theory to seek external validation of the shortened 
scale by correlating these scores with our scores when using a university student sample. 


Methods 

As noted above, we based our validation on four different studies based on four different samples 
(three at school level, one at University level). In all studies, the response to the nine-item 
questionnaire was at the end of the lesson (usually within the last five minutes). 

Participants and Data Collection 

The first study was based on 393 pupils (188 boys, 205 girls) from South-Western Germany. The 
pupils (all 5 th and 6 th graders) participated in an educational unit about bird flight (Flummel & 
Randier, 2010). All teaching was based on the same kind of instruction. The teaching materials 
were standardised by using a booklet where a hands-on educational unit was offered. Fourteen 
different teachers participated in the study. Of course, there may still be differences between the 
individual teachers, but we aimed for at least some kind of standardisation by providing 
standardised teaching materials and a booklet guiding pupils through their learning process. At 
the end of the lesson, pupils filled in the questionnaire and we used these data for the 
confirmatory factor analysis. 

The second study was based on 141 pupils (74 girls, 67 boys), aged 12-19 years consisting 
of 7 th (12) 8 th (24) 9 th (50) 10 th (55) graders. Different subjects such as biology, chemistry, Ger¬ 
man language and social sciences were taught by different teachers to assess differences between 
subjects and grades. At the end of a lesson, the pupils filled in the questionnaire and we 
compared the situational emotions. We suppose that situational differences should occur between 
subject and grades. 

The third study used one lesson (90 minutes) about the water lily from a standardised educa¬ 
tional program developed by Randier & Bogner (2009), and a 90 minute lesson about snail eco- 
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logy designed by Hummel & Randier (2010). Ninety-seven pupils (48 boys, 49 girls; 53 5 th and 
44 6 th graders) participated in this aspect of the study. We focused on assessing intra-individual 
differences by applying two similar instructions (hands-on experiments) based on different to¬ 
pics, one instruction dealing with a zoological topic (snail), and the other was a botanical topic 
(water lily). As we know from previous research in interest in biology (Randier & Bogner, 2007), 
pupils generally rate zoological topics higher and as more interesting than botanical ones. As 
such, we expected that pupils should give higher scores in interest and well-being and lower 
scores in boredom after the zoological topic, than they would do for the botanical topic. 
However, these previous ratings have only been measured using trait scales (as compared to 
situational scales). 

The fourth study sought additional external validity and was done with University students 
at the University of Education Heidelberg. We compared measures of our situational emotions 
scale with another short scale as provided by Wilde, Batz, Kovaleva, & Urhahne (2009; labelled 
KIM - Kurzskala zur Intrinsischen Motivation - short scale for intrinsic motivation). This 
construct is based on measuring motivation based on the self-determination theory of Deci & 
Ryan (1985, 2003), which contains the domains interest/enjoyment, competence, pressure/tension 
(negative), and perceived choice. At the end of each course, students filled in both questionnaire; 
the KIM and our scale for situational emotions. We calculated the overall means over 11 course 
days (which were assessed each time) and used the individual data to calculate correlation 
coefficients as an indicator of external validity. 

Statistical Methods 

Confirmatory factor analysis (study I): As the three independent factors have been derived from 
theoretical constructs (Glaser-Zikuda et al., 2005), we assessed the model by using a confirmatory 
factor analysis (Brown, 2006) using LISREL 8.80 (Joreskog & Sorbom, 1993). In study II, we 
used t-tests and one-way-ANOVA to compare the answers according to grade, subject and gend¬ 
er. To assess different variables in parallel, we used a general linear model (GLM). In a first step, 
all independent variables entered the model simultaneously, and in the second step, all non¬ 
significant variables were removed to produce the final model. In study III, we compared the 
answers of the pupils to the zoological and botanical topic by using paired t-Tests. Finally, for 
study IV, the validation with the KIM, we used Pearson’s correlations to assess the relationship 
between the three emotional constructs of our scale and the four constructs of the KIM. 


Results 

Study I - Factor Structure of the Scale 

In this study, all pupils received the same educational treatment, and there should be no influence 
of the treatment itself on the quality of the rating. Three factors could be confirmed representing 
three emotional dimensions: interest, well-being and boredom. The confirmatory factor analysis 
provides sufficient evidence for the construct validity of the three factors of the scale (see Figure 
1): ML Chi-Square = 58.30 (P = 0.00011), df = 24, Root Mean Square Error of Approximation 
(RMSEA) = 0.064, Comparative Fit Index (CFI) = 0.99, Normed Fit Index (NFI) = 0.98, Non- 
Normed Fit Index (NNFI) = 0.98, Comparative Fit Index (CFI) = 0.99; Goodness of Fit Index 
(GFI) = 0.96, Adjusted Goodness of Fit Index (AGFI) = 0.93. Cronbach’s alpha was .86 for well¬ 
being, .81 for interest, and .77 for boredom. 
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Chi-Square=58.30, df=24, P-value=0.00011, RMSEA=0.064 

Figure 1. Confirmatory factor analysis of the three constructs interest, well-being 

and boredom 


Study II - Differences between Subjects 

Reliability was calculated using Cronbach’s a of .79 for well-being, of .73 for interest, and of .72 
for boredom. As this study was based on different age groups and grades of the pupils and on 
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Table 1. Final General Linear Model (GLM) based on class grade and subject as fixed 
factors. Dependent variables were the three emotional sub-scales (interest, well-being, and 

boredom) 


Source of va¬ 
riance 

Dependent vari¬ 
able 

df 

Mean of 
Squares 

F 

P-value 

Partial Eta- 
squared 

Corrected Model 

Well-being 

6 

3.106 

4.718 

.000 

.174 


Interest 

6 

4.394 

6.075 

.000 

.214 


Boredom 

6 

2.377 

2.769 

.014 

.110 

Grade 

Well-being 

2 

5.461 

8.296 

.000 

.110 


Interest 

2 

7.387 

10.213 

.000 

.132 


Boredom 

2 

4.496 

5.238 

.006 

.073 

Subject 

Well-being 

3 

3.572 

5.427 

.001 

.108 


Interest 

3 

5.325 

7.361 

.000 

.141 


Boredom 

3 

2.117 

2.467 

.065 

.052 


different types of lessons and subjects, we expected differences between the variables (e.g., gen¬ 
der, grade, age groups). As a first step, we used a general linear model (GLM) with age as 
covariate, gender, subject and grade as fixed factors. In this model, we revealed no significant 
main effect for gender and for age (covariate), thus, these variables were removed from the mo¬ 
del. The final model (Table 1) showed a significant influence of subject and of grade. The 
assessment of interest, well-being and boredom is different in different grades and in different 
subjects. This provides evidence for the fact that different instructions are assessed differently by 
the pupils which, in turn, confirms the situational characteristic of the scale. Also, different 
instructions, teachers and lessons may have evoked different situational emotions. 

Study III - Intra-individual Differences 

We obtained reliabilities of .82 (snail) and .83 (water lily) for well-being, of .73 (snail) and .74 
(water lily) for interest, and of .80 (snail) and .82 (water lily) for boredom. In this study, the same 
pupils received two different lessons that were identical in structure. Both were biological hands- 
on lessons (see methods) but they differed in the subject matter (zoological versus botanical to¬ 
pic): We found significant differences between the two lessons (snail ecology versus water lily). 
Pupils rated the zoological topic snail as more interesting and less boring than the botanical topic 
water lily, and felt better (Table 2). This indicates that the scale is sensitive to changes on the 

Table 2. Comparison of dependent situational emotion scale (botanical topic water-lily 

versus zoological topic snail) 



Mean 

SD 

T 

df 

P 

Interest Snail 

3.46 

1.12 

5.627 

96 

<.001 

Interest Water lily 

2.63 

1.17 




Well-being Snail 

3.84 

1.13 

3.707 

96 

<.001 

Well-being Water lily 

3.27 

1.23 




Boredom Snail 

1.93 

1.16 

-4.136 

96 

<.001 

Boredom Water lily 

2.49 

1.29 
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individual level because the same individuals rated the different lessons in a different manner (a 
typical trait variable should be constant over time and not sensitive towards changes). 

Study IV- External Validity 

The fourth study sought additional external validity with a well-known instrument derived from 
Deci & Ryan (2003; in the shortened German version, labeled KIM: Kurzskala zur Intrinsischen 
Motivation - short scale for assessing intrinsic motivation). As noted earlier, this scale can be 
used at the end of a lesson or at the end of an educational unit and assesses four dimension of 
motivation. There were significant correlations between the different dimensions, e.g., the KIM 
interest scale was positively related to the interest and well-being scales of our scale and 
negatively related to the boredom scale. Similarly, KIM competence was positively related to 
interest and well-being and negatively to boredom of our scales. KIM pressure/tension was 
negatively related to well-being and positively to boredom, suggesting that students feeling 
pressed experienced higher boredom and lower well-being. KIM perceived choice showed the 
lowest correlations because this measures a slightly different construct, but perceived choice was 
positively related to well-being. 


Discussion 

Our study provides evidence that a shortened scale is sufficient to measure short-term learning 
situational emotions, and therefore is a suitable means for educational research of this nature. The 
shortness of the scale allows an application more than once during an educational unit (as noted 
earlier, longer scales may stir up aversion or reactance). Overall the emotional variables were 
rated differently with regard to grades and/or subject matter, which suggest that our scale is 
suitable to measure differences between lessons, and within pupil cohorts. In study-II, no 
differences in age and gender were revealed which suggests that the scale can be applied 
effectively from age 10 onwards until (and including) university age students. We do, however, 
recognize that such differences may emerge from a larger sample size - something which may 
provide an interesting issue for investigation. 

The within subject differences from study III point towards a real situational characteristic 
of our scale because the same pupils rated the different lessons differently (as expected), and the 


Table 3. Correlations between the three measures of situational emotions with a short measure¬ 
ment of intrinsic motivation based on the short scale for intrinsic motivation (KIM) (Sample size 

N=175) 




Interest 

Well-being 

Boredom 

Interest (KIM) 

Pearson’s correlation 

.567” 

.904” 

-.604” 


Significance 

.000 

.000 

.000 

Competence 

Pearson’s correlation 

.262 

.428” 

-.352 


Significance 

.000 

.000 

.000 

Choice 

Pearson’s correlation 

.130 

.230” 

-.052 


Significance 

.086 

.002 

.494 

Pressure/tension 

Pearson’s correlation 

-.055 

-.262“ 

.192* 


Significance 

.472 

.000 

.011 
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teacher was identical, thus removing any teacher effects from the results (Randier & Bogner, 

2009) . This suggests that the scale is sensitive towards changes. Furthermore, study ill adds 
external validity, because trait survey studies on interest in biology revealed that the zoological 
topics were more interesting to the pupils than the botanical ones (see, e.g., Lowe, 1992; Hong, 
Shim, & Chang, 1998; Lindemann-Matthies, 2005). This difference between zoological and 
botanical topics found in trait interest studies is reflected in our measurements of situational 
interest. 

In study IV, we sought external validity by correlating our situational emotion scale with an 
established measurement on motivation, the KIM based on the motivational theory of Deci & 
Ryan (1985), as provided by Wilde et al. (2009). Both interest scales correlated with each other 
and in both cases boredom was negatively related to intrinsic motivation (see also Pekrun et al., 

2010) suggesting that the scale, although shortened, remains valid. In turn, the Cronbach’s a 
scores attributed to the data attest to the internal reliability of the instrument. 


Appendix: The short version of the questionnaire to measure situational emotions. 
I = Interest, WB = well-being, B = boredom 


Original items of the situational emotion short English translation 
scale 

WB_1 Die Stunde hat mir Freude gemacht. The lesson pleased me. 


I_1 Ich fand das Thema wichtig. 

B_1 Ich habe mich gelangweilt. 

WB_2 Ich war mit der Stunde zufrieden. 

B_2 Ich war mit den Gedanken heute ofter wo- 
anders. 

WB_3 Der Unterricht hat mir Spa!) gemacht. 

I_2 Was ich iiber das Thema erfahren habe, 
bringt mir was. 

I_3 Ich mochte mehr tiber das Thema erfahren. 
B_3 Die heutige Stunde war zum Einschlafen. 


I found that topic important. That topic was im¬ 
portant. 

I felt bored. 

I was satisfied with the lesson. 

(Today) I was sometimes absent with my 
thoughts. 

I enjoyed the lesson. 

The information on that topic yields something to 
me. 

I want to learn more about that topic. 

The lesson was to sleep in. 
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Fen egitiminde durumsal duygulari ol^mek i^in kisa bir ol^egin giivenirligi ve 
ge^erligi 

Ara§tirmalar duygularm ogrenme siirecinde ve akademik ba§anda anlamli bir rol oynadigim 
gostermi§tir. Fakat duygularm ogretim siirecinde ya da sonrasmda olgumii uzun cevap gerektiren 
yazili olgii araglanni gerektirmesi ger 9 egi nedeniyle ara§tnmacilarm smifta bu konu ile ilgili 
gahjjiuaktan neden kagindiklanni ortaya koymaktadir. Bu nedenle bikkmlik, iyi olma hali ve ilgi 
iiglti faktorlerini igcrcn 119 maddeli fen ogretimi esnasmda ergen duygulanm ol 9 meyi ama 9 layan 
bir kisa likert tipi ol 9 ek geli§tirdik. Onegin ge 9 erliligini tespit i 9 in dort popiilasyonda dort 
9 ali§ma sunuyoruz. Ol 9 me aracinm ge 9 erlik ve giivenirligini tespit etmek amaci ile giiney bati 
Almanyadaki 14 ogretmen tarafmdan verilen standart derslerden sonra, 6-12 similar diizeyindeki 
geni§ bir ogrenci grubuna uygulandi. Elde edilen veriler giivenirlik ve ge 9 erlikleri ile ilgili olarak 
istatistiksel analize tabii tutuldu. Teorik yapidan elde edilen 119 bagimsiz faktor (ilgi, iyi olma hali 
ve bikkmlik) i 9 in dogrulayici faktor analizi uygulandi. Farkli ya§ gruplan, dereceler ve okul 
konularma dayanan ikinci 9 ali§mada o^egin ya§ ve konu paremetleri ile ilgili olarak hassasiyetini 
tespit ettik. U 9 iincii 9 ali§mada ci^cgin duygulardaki degi§imle ilgili hassasiyetini ol 9 mek amaci 
ile be§inci ve altmci simflarin botanik ve zoolojideki iki standart egitim programlari kullamldi. 
Ogrenciler zooloji ile ilgili konulari botanikle kar§ila§tirildigmda daha ilgin 9 , daha az sikici 
buldular ve kendilerini daha iyi hissetiler. Di§ ge 9 erlik, iiniversite ogrencileri ile dordiincii 
9 ah§mada kullandigimiz ol 9 ekten elde edilen veriler ile motivasyonun o^iilmesinden elde edilen 
verilerin (KIM'in kisaltilmi§ Alman versiyonu) korelasyonu ile belirlenmi§tir. Elde edilen veriler 
119 faktoriin tatmin edici bir kiime olu§turdugunu, smif zamanim fazla etkilemeden uygulanabilen 
o^egin hem giivenilir hem de ge 9 erli oldugunu ortaya koymaktadir. 

Anahtar kelimeler: fen egitimi, bikkmlik, duygular, ilgi, iyi olma hali, kisa ol 9 me aleti 



